Display system with image display correction mechanism and method of operation thereof

ABSTRACT

A method of operation of a display system includes: sending a known test sample; retrieving the known test sample; comparing the known test sample and the retrieved known test sample; generating a compensation model based on the comparison for correcting the retrieved known test sample; and providing the compensation model for displaying a corrected display on a device.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims the benefit of U.S. Provisional PatentApplication Ser. No. 61/694,168 filed Aug. 28, 2012, and the subjectmatter thereof is incorporated herein by reference thereto.

TECHNICAL FIELD

An embodiment of the present invention relates generally to a displaysystem, and more particularly to a system for image display.

BACKGROUND

Modern consumer and industrial electronics, especially devices such asgraphical display systems, televisions, projectors, cellular phones,portable digital assistants, and combination devices, are providingincreasing levels of functionality to support modern life includingimage display. Research and development in the existing technologies cantake a myriad of different directions.

Image display decisions are made every day in many aspects of commerce.When consumers purchase products, image display can be a major influenceon the purchasing decision. In modern commerce, there is the ability topurchase over the Internet or through other virtual means. This abilitymakes the accurate and precise image display even more important sincesuch displays represent through presentation the image display ofphysical products. It would be disappointing to the purchaser topurchase a product over the Internet under the belief that it was theone in the image display and receive the product only to later realizethat the image display was not displayed properly when the product waspurchased.

The ability to reproduce precise and accurate image display in a displaydevice is also important in the business of advertising, productpackaging and product manufacturing. When such materials are beingcreated, online virtual collaboration systems can be used to review andapprove product prototypes of printed images. In these cases, it wouldbe advantageous to use a system or method for reproducing precise andaccurate image displays on display devices.

Web video is becoming a very important media type as the Internet isbecoming a part of our ordinary life and a major channel to obtaininformation. Many types of information are available by watching webvideos on your PC, PDA, smart phone, and digital media player. In orderto allow the web video clips to be readily accessible under therestriction of network bandwidth and storage space, web video clips aregenerally compressed heavily, which results in degraded images andvideo.

Thus, a need still remains for an image display system with imagedisplay correction mechanism to display images. In view of theever-increasing commercial competitive pressures, along with growingconsumer expectations and the diminishing opportunities for meaningfulproduct differentiation in the marketplace, it is increasingly criticalthat answers be found to these problems. Additionally, the need toreduce costs, improve efficiencies and performance, and meet competitivepressures adds an even greater urgency to the critical necessity forfinding answers to these problems.

Solutions to these problems have been long sought but prior developmentshave not taught or suggested any solutions and, thus, solutions to theseproblems have long eluded those skilled in the art.

SUMMARY

An embodiment of the present invention provides a method of operation ofa display system including: sending a known test sample; retrieving theknown test sample; comparing the known test sample and the retrievedknown test sample; generating a compensation model based on thecomparison for correcting the retrieved known test sample; and providingthe compensation model for displaying a corrected display on a device.

An embodiment of the present invention provides a method of operation ofa display system including: sending a known test sample having a gamut;retrieving the known test sample having a degraded gamut; comparing,with a control unit, the gamut of the known test sample and the degradedgamut of the retrieved known test sample; generating a compensationmodel based on the comparison for correcting the retrieved known testsample; and providing the compensation model for displaying a correcteddisplay on a device.

An embodiment of the present invention provides a display system,including: a communication unit configured to send a known test sampleand configured to retrieve the known test sample; a control unitconfigured to compare the known test sample and the retrieved known testsample, and configured to generate a compensation model based on thecomparison for correcting the retrieved known test sample; and a storageunit configured to provide the compensation model for displaying acorrected display on a device.

Certain embodiments of the invention have other steps or elements inaddition to or in place of those mentioned above. The steps or elementswill become apparent to those skilled in the art from a reading of thefollowing detailed description when taken with reference to theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a display system with image display correction mechanism in anembodiment of the present invention.

FIGS. 2 a and 2 b are examples of images on a display interface of thefirst device of FIG. 1.

FIG. 3 is an exemplary block diagram of the display system.

FIG. 4 is a control flow of the display system.

FIG. 5 is a flow chart of a method of operation of a display system in afurther embodiment of the present invention.

DETAILED DESCRIPTION

The following embodiments are described in sufficient detail to enablethose skilled in the art to make and use the invention. It is to beunderstood that other embodiments would be evident based on the presentdisclosure, and that system, process, or mechanical changes may be madewithout departing from the scope of the present invention.

In the following description, numerous specific details are given toprovide a thorough understanding of the invention. However, it will beapparent that the invention may be practiced without these specificdetails. In order to avoid obscuring the present invention, somewell-known circuits, system configurations, and process steps are notdisclosed in detail.

The drawings showing embodiments of the system are semi-diagrammatic,and not to scale and, particularly, some of the dimensions are for theclarity of presentation and are shown exaggerated in the drawingfigures. Similarly, although the views in the drawings for ease ofdescription generally show similar orientations, this depiction in thefigures is arbitrary for the most part. Generally, the invention can beoperated in any orientation.

The term “module” referred to herein can include software, hardware, ora combination thereof in the present invention in accordance with thecontext in which the term is used. For example, the software can bemachine code, firmware, embedded code, and application software. Alsofor example, the hardware can be circuitry, processor, computer,integrated circuit, integrated circuit cores, a pressure sensor, aninertial sensor, a microelectromechanical system (MEMS), passivedevices, or a combination thereof

Referring now to FIG. 1, therein is shown a display system 100 withimage display correction mechanism in an embodiment of the presentinvention. The display system 100 includes a first device 102, such as aclient or a server, connected to a second device 106, such as a clientor server. The first device 102 can communicate with the second device106 with a communication path 104, such as a wireless or wired network.

For example, the first device 102 can be of any of a variety of displaydevices, such as a cellular phone, personal digital assistant, anotebook computer, a liquid crystal display (LCD) system, a lightemitting diode (LED) system, or other multi-functional display orentertainment device. The first device 102 can couple, either directlyor indirectly, to the communication path 104 to communicate with thesecond device 106 or can be a stand-alone device.

For illustrative purposes, the display system 100 is described with thefirst device 102 as a display device, although it is understood that thefirst device 102 can be different types of devices. For example, thefirst device 102 can also be a device for presenting images or amulti-media presentation. A multi-media presentation can be apresentation including sound, a sequence of streaming images or a videofeed, or a combination thereof. As an example, the first device 102 canbe a high definition television, a three dimensional television, acomputer monitor, a personal digital assistant, a cellular phone, or amulti-media set.

The second device 106 can be any of a variety of centralized ordecentralized computing devices, or video transmission devices. Forexample, the second device 106 can be a multimedia computer, a laptopcomputer, a desktop computer, a video game console, grid-computingresources, a virtualized computer resource, cloud computing resource,routers, switches, peer-to-peer distributed computing devices, a mediaplayback device, a Digital Video Disk (DVD) player, a three-dimensionenabled DVD player, a recording device, such as a camera or videocamera, or a combination thereof. In another example, the second device106 can be a signal receiver for receiving broadcast or live streamsignals, such as a television receiver, a cable box, a satellite dishreceiver, or a web enabled device.

The second device 106 can be centralized in a single room, distributedacross different rooms, distributed across different geographicallocations, embedded within a telecommunications network. The seconddevice 106 can couple with the communication path 104 to communicatewith the first device 102.

For illustrative purposes, the display system 100 is described with thesecond device 106 as a computing device, although it is understood thatthe second device 106 can be different types of devices. Also forillustrative purposes, the display system 100 is shown with the seconddevice 106 and the first device 102 as end points of the communicationpath 104, although it is understood that the display system 100 can havea different partition between the first device 102, the second device106, and the communication path 104. For example, the first device 102,the second device 106, or a combination thereof can also function aspart of the communication path 104.

The communication path 104 can span and represent a variety of networks.For example, the communication path 104 can include wirelesscommunication, wired communication, optical, ultrasonic, or thecombination thereof. Satellite communication, cellular communication,Bluetooth, Infrared Data Association standard (lrDA), wireless fidelity(WiFi), and worldwide interoperability for microwave access (WiMAX) areexamples of wireless communication that can be included in thecommunication path 104. Ethernet, digital subscriber line (DSL), fiberto the home (FTTH), and plain old telephone service (POTS) are examplesof wired communication that can be included in the communication path104. Further, the communication path 104 can traverse a number ofnetwork topologies and distances. For example, the communication path104 can include direct connection, personal area network (PAN), localarea network (LAN), metropolitan area network (MAN), wide area network(WAN), or a combination thereof.

Referring now to FIGS. 2 a and 2 b, therein is shown examples of imageson a first display 202 of the first device of FIG. 1. FIG. 2 a depicts aknown sample of graphics 204 on first display 202 of the first device102 and FIG. 2 b depicts a degraded sample of graphics 204 shown asgraphics 214 on the second display 212 on the first device 102. Thefirst display 202 can display graphics 204 that include images or video.

The graphics 204 including images or video can preferably be formed ofmultiple pixels 206 having a color or chromaticity. Each of a pixel 206or group of the pixels 206 can be measured or mapped using mathematicallanguage, equations, or expressions, such as gamut mapping.

Similarly, the graphics 214 including images or video can preferably beformed of multiple pixels 216 having a color or chromaticity. The coloror chromaticity of the pixels 216 can change or degrade throughprocesses such as uploading, downloading, any transfer method, orcombination thereof, from the color or chromaticity of the pixels 206.

Color of the graphics 204 can be measured or modeled for each of thepixel 206 or groups of the pixel 206. The measured or modeled color ofthe graphics 204 can be characterized using a gamut mapping technique. Aknown test sample of the graphics 204 can be characterized by a gamutmap for comparison with a gamut map of the graphics 214 that has beentransferred such as uploaded or downloaded from remote device such as aweb server including a web video server.

The visual differences or comparison in terms of brightness, color andsharpness between the known test sample and the downloaded known testsample can be seen by common viewers. Generally the downloaded knowntest examples have degraded image qualities which include decreasedbrightness, less brightness and color contrast, changed colors, andreduced sharpness, etc.

Color fade and shift is one of the common image quality problemsassociated with web video. To solve this problem, an image colorcorrection or improvement technique can include several aspects relatedto color including but not limited to chromaticity, luminance, hue,saturation, chroma, intensity, wavelength, purity, or combinationthereof.

For example, color quality of the image or video can be improved byinversely compensating the improper color changes such as color fade orshift introduced by transferring such as uploading or downloading thegraphics 204, based on an appropriate degradation model, such as ColorDegradation Model Metadata (CDMM) of a web video server from which theimage(s) or video was sourced.

All these image quality degradations can be quantitatively detected andcharacterized. A preferred characterization and correction method isdeveloped and provided in the invented display system to deal with theproblem of changed or degraded colors, which however can also improveother types of image qualities to some extent. For example, withcorrected colors, the color contrast can be significantly improved. Inaddition, brightness contrast as well as image sharpness may be enhancedas well.

A Color Degradation Model Metadata can be provided by a compute server,the first device 102, or the second device 106 for specific sources suchas web servers based on comparison with the known test sample of thegraphics 204 and a transferred sample of the graphics 204 from thespecific source or web server. The compensation model, which can includeColor Degradation Model Metadata for the specific source or web server,can be applied for improved quality to other graphics including imagesor video received from the specific web server.

It has been discovered that the display system with image displaycorrection mechanism provides consistently improved graphics includingimages and video, at least based on application of a compensation model,including a degradation model, such as Color Degradation Model Metadata,a correction model, or combination thereof, applied to images and videofrom a specific source. The gamut map of the graphics 204 are comparedto the degraded gamut map of the graphics 214 characterizing at leastcolor fade and shift for the specific remote device.

Referring now to FIG. 3, therein is shown an exemplary block diagram ofthe display system 100. The display system 100 can include the firstdevice 102, the communication path 104, and the second device 106. Thefirst device 102 can send information in a first device transmission 308over the communication path 104 to the second device 106. The seconddevice 106 can send information in a second device transmission 310 overthe communication path 104 to the first device 102.

For illustrative purposes, the display system 100 is shown with thefirst device 102 as a client device, although it is understood that thedisplay system 100 can have the first device 102 as a different type ofdevice. For example, the first device 102 can be a server having adisplay interface and a display.

Also for illustrative purposes, the display system 100 is shown with thesecond device 106 as a server, although it is understood that thedisplay system 100 can have the second device 106 as a different type ofdevice. For example, the second device 106 can be a client device.

For brevity of description in this embodiment of the present invention,the first device 102 will be described as a client device and the seconddevice 106 will be described as a server device. The present inventionis not limited to this selection for the type of devices. The selectionis an example of the present invention.

The first device 102 can include a first control unit 312, a firststorage unit 314, a first communication unit 316, and a first userinterface 318. The first control unit 312 can include a first controlinterface 322. The first control unit 312 can execute a first software326 to provide the intelligence of the display system 100.

The first control unit 312 can be implemented in a number of differentmanners. For example, the first control unit 312 can be a processor, anapplication specific integrated circuit (ASIC), an embedded processor, amicroprocessor, a hardware control logic, a hardware finite statemachine (FSM), a digital signal processor (DSP), or a combinationthereof. The first control interface 322 can be used for communicationbetween the first control unit 312 and other functional units in thefirst device 102. The first control interface 322 can also be used forcommunication that is external to the first device 102.

The first control interface 322 can receive information from the otherfunctional units or from external sources, or can transmit informationto the other functional units or to external destinations. The externalsources and the external destinations refer to sources and destinationsexternal to the first device 102.

The first control interface 322 can be implemented in different ways andcan include different implementations depending on which functionalunits or external units are being interfaced with the first controlinterface 322. For example, the first control interface 322 can beimplemented with a pressure sensor, an inertial sensor, amicroelectromechanical system (MEMS), optical circuitry, waveguides,wireless circuitry, wireline circuitry, or a combination thereof.

The first storage unit 314 can store the first software 326. The firststorage unit 314 can also store the relevant information, such as datarepresenting incoming images, data representing previously presentedimage, sound files, or a combination thereof.

The first storage unit 314 can be a volatile memory, a nonvolatilememory, an internal memory, an external memory, or a combinationthereof. For example, the first storage unit 314 can be a nonvolatilestorage such as non-volatile random access memory (NVRAM), Flash memory,disk storage, or a volatile storage such as static random access memory(SRAM).

The first storage unit 314 can include a first storage interface 324.The first storage interface 324 can be used for communication betweenthe first storage unit 314 and other functional units in the firstdevice 102. The first storage interface 324 can also be used forcommunication that is external to the first device 102.

The first storage interface 324 can receive information from the otherfunctional units or from external sources, or can transmit informationto the other functional units or to external destinations. The externalsources and the external destinations refer to sources and destinationsexternal to the first device 102.

The first storage interface 324 can include different implementationsdepending on which functional units or external units are beinginterfaced with the first storage unit 314. The first storage interface324 can be implemented with technologies and techniques similar to theimplementation of the first control interface 322.

The first communication unit 316 can enable external communication toand from the first device 102. For example, the first communication unit316 can permit the first device 102 to communicate with the seconddevice 106 of FIG. 1, an attachment, such as a peripheral device or adesktop computer, and the communication path 104.

The first communication unit 316 can also function as a communicationhub allowing the first device 102 to function as part of thecommunication path 104 and not limited to be an end point or terminalunit to the communication path 104. The first communication unit 316 caninclude active and passive components, such as microelectronics or anantenna, for interaction with the communication path 104.

The first communication unit 316 can include a first communicationinterface 328. The first communication interface 328 can be used forcommunication between the first communication unit 316 and otherfunctional units in the first device 102. The first communicationinterface 328 can receive information from the other functional units orcan transmit information to the other functional units.

The first communication interface 328 can include differentimplementations depending on which functional units are being interfacedwith the first communication unit 316. The first communication interface328 can be implemented with technologies and techniques similar to theimplementation of the first control interface 322.

The first user interface 318 allows a user (not shown) to interface andinteract with the first device 102. The first user interface 318 caninclude an input device and an output device. Examples of the inputdevice of the first user interface 318 can include a keypad, a touchpad,soft-keys, a keyboard, a microphone, an infrared sensor for receivingremote signals, or any combination thereof to provide data andcommunication inputs.

The first user interface 318 can include a first display interface 330as an output device. The first display interface 330 can output to thefirst display 202, such as a projector, a video screen, a speaker, orany combination thereof.

The first control unit 312 can operate the first user interface 318 todisplay information generated by the display system 100. The firstcontrol unit 312 can also execute the first software 326 for the otherfunctions of the display system 100. The first control unit 312 canfurther execute the first software 326 for interaction with thecommunication path 104 via the first communication unit 316.

The second device 106 can be used for implementing the present inventionin a multiple device embodiment with the first device 102. The seconddevice 106 can provide the additional or higher performance processingpower compared to the first device 102. The second device 106 caninclude a second control unit 334, a second communication unit 336, asecond user interface 338, and a second storage unit 346.

The second user interface 338 allows a user (not shown) to interface andinteract with the second device 106. The second user interface 338 caninclude an input device and an output device. Examples of the inputdevice of the second user interface 338 can include a keypad, atouchpad, soft-keys, a keyboard, a microphone, or any combinationthereof to provide data and communication inputs. Examples of the outputdevice of the second user interface 338 can include a second displayinterface 340. The second display interface 340 can output to a seconddisplay 212 of FIG. 2, such as a projector, a video screen, a speaker,or any combination thereof.

The second control unit 334 can execute a second software 342 to providethe intelligence to the second device 106 of the display system 100. Thesecond software 342 can operate in conjunction with the first software326. The second control unit 334 can provide additional performancecompared to the first control unit 312.

The second control unit 334 can operate the second user interface 338 todisplay information. The second control unit 334 can also execute thesecond software 342 for the other functions of the display system 100,including operating the second communication unit 336 to communicatewith the first device 102 over the communication path 104.

The second control unit 334 can be implemented in a number of differentmanners. For example, the second control unit 334 can be a processor, anembedded processor, a microprocessor, hardware control logic, a hardwarefinite state machine (FSM), a digital signal processor (DSP), or acombination thereof.

The second control unit 334 can include a second control interface 344.The second control interface 344 can be used for communication betweenthe second control unit 334 and other functional units in the seconddevice 106. The second control interface 344 can also be used forcommunication that is external to the second device 106.

The second control interface 344 can receive information from the otherfunctional units or from external sources, or can transmit informationto the other functional units or to external destinations. The externalsources and the external destinations refer to sources and destinationsexternal to the second device 106.

The second control interface 344 can be implemented in different waysand can include different implementations depending on which functionalunits or external units are being interfaced with the second controlinterface 344. For example, the second control interface 344 can beimplemented with a pressure sensor, an inertial sensor, amicroelectromechanical system (MEMS), optical circuitry, waveguides,wireless circuitry, wireline circuitry, or a combination thereof.

A second storage unit 346 can store the second software 342. The secondstorage unit 346 can also store the information, such as datarepresenting incoming images, data representing previously presentedimage, sound files, or a combination thereof. The second storage unit346 can be sized to provide the additional storage capacity tosupplement the first storage unit 314.

For illustrative purposes, the second storage unit 346 is shown as asingle element, although it is understood that the second storage unit346 can be a distribution of storage elements. Also for illustrativepurposes, the display system 100 is shown with the second storage unit346 as a single hierarchy storage system, although it is understood thatthe display system 100 can have the second storage unit 346 in adifferent configuration. For example, the second storage unit 346 can beformed with different storage technologies forming a memory hierarchalsystem including different levels of caching, main memory, rotatingmedia, or off-line storage.

The second storage unit 346 can be a volatile memory, a nonvolatilememory, an internal memory, an external memory, or a combinationthereof. For example, the second storage unit 346 can be a nonvolatilestorage such as non-volatile random access memory (NVRAM), Flash memory,disk storage, or a volatile storage such as static random access memory(SRAM).

The second storage unit 346 can include a second storage interface 348.The second storage interface 348 can be used for communication betweenthe second storage unit 346 and other functional units in the seconddevice 106. The second storage interface 348 can also be used forcommunication that is external to the second device 106.

The second storage interface 348 can receive information from the otherfunctional units or from external sources, or can transmit informationto the other functional units or to external destinations. The externalsources and the external destinations refer to sources and destinationsexternal to the second device 106.

The second storage interface 348 can include different implementationsdepending on which functional units or external units are beinginterfaced with the second storage unit 346. The second storageinterface 348 can be implemented with technologies and techniquessimilar to the implementation of the second control interface 344.

The second communication unit 336 can enable external communication toand from the second device 106. For example, the second communicationunit 336 can permit the second device 106 to communicate with the firstdevice 102 over the communication path 104.

The second communication unit 336 can also function as a communicationhub allowing the second device 106 to function as part of thecommunication path 104 and not limited to be an end point or terminalunit to the communication path 104. The second communication unit 336can include active and passive components, such as microelectronics oran antenna, for interaction with the communication path 104.

The second communication unit 336 can include a second communicationinterface 350. The second communication interface 350 can be used forcommunication between the second communication unit 336 and otherfunctional units in the second device 106. The second communicationinterface 350 can receive information from the other functional units orcan transmit information to the other functional units.

The second communication interface 350 can include differentimplementations depending on which functional units are being interfacedwith the second communication unit 336. The second communicationinterface 350 can be implemented with technologies and techniquessimilar to the implementation of the second control interface 344.

The first communication unit 316 can couple with the communication path104 to send information (e.g. a known test sample) to the second device106 in the first device transmission 308. The second device 106 canreceive information in the second communication unit 336 from the firstdevice transmission 308 of the communication path 104.

The second communication unit 336 can couple with the communication path104 to send information to the first device 102 in the second devicetransmission 310. The first device 102 can receive (or retrieve)information in the first communication unit 316 from the second devicetransmission 310 of the communication path 104.

The display system 100 can be executed by the first control unit 312,the second control unit 334, or a combination thereof. For illustrativepurposes, the second device 106 is shown with the partition having thesecond user interface 338, the second storage unit 346, the secondcontrol unit 334, and the second communication unit 336, although it isunderstood that the second device 106 can have a different partition.For example, the second software 342 can be partitioned differently suchthat some or all of its function can be included in the second controlunit 334 and the second communication unit 336. Also, the second device106 can include other functional units not shown in FIG. 3 for clarity.

The functional units in the first device 102 can work individually andindependently of the other functional units. The first device 102 canwork individually and independently from the second device 106 and thecommunication path 104.

The functional units in the second device 106 can work individually andindependently of the other functional units. The second device 106 canwork individually and independently from the first device 102 and thecommunication path 104.

For illustrative purposes, the display system 100 is described byoperation of the first device 102 and the second device 106. It isunderstood that the first device 102 and the second device 106 canoperate any of the modules and functions of the display system 100.

Referring now to FIG. 4, therein is shown a control flow of the displaysystem 100 with image display correction mechanism. In a manner similarto the description of FIGS. 2 a and 2 b, at least color fade and shiftin images and video are corrected and improved. A known test sample isspecifically created in such a way that the colors appearing on theimages uniformly cover the whole available gamut range. So on thechromatic plane (LUV or XYZ based color spaces can be used), the datapoints (each point represents a color existing in the frame/image) arerather uniformly distributed across the whole gamut defined by sRGBcolor space.

After an image or video is uploaded to a web video server and watched ona website, the color quality of the video image generally appearsdegraded to various extents. If the published video clip is downloadedand watched on a local PC (or PDA or smart phone, etc.), further colorquality degradation may be observed. The color quality degradation canappear to human viewers as color shift or fade while on the chromaticplane it appears as movement of data points from their originalpositions. If the data points on the chromatic plane are considered as agrid or mesh, then the color degradation can result in a shifting anddeformation of the grid, called gamut mapping, which can becharacterized using various mathematic methods.

In an embodiment of a characterization and correction method for colordegradation, the quantitative comparison between the known test sampleand the downloaded known test sample is performed in the chromaticdomain. First, the image pixels' colors (chromaticity values) arecomputed and recorded on the chromatic plane as (data) points whose xycoordinates are chromaticity values. All the points from the known testsample can be considered to construct a mesh. Similarly, all the pointsfrom the downloaded known test sample can also construct a mesh.

At each pixel location, the known test sample and the downloaded knowntest sample generally have different colors that correspond to twodifferent locations on the color plane. The color change between the twocolors, e.g. data points, can be characterized as a simple lineartranslation or displacement. However, to characterize the color changebetween the colors of all pixels between the two samples, the meshconcept can be utilized and the color change can be interpreted as atwo-dimensional (2D) spatial transformation problem that transforms onemesh to the other. In the field of image processing, the color change ofall the colors within a color gamut is called gamut mapping.

To deal with the gamut mapping problem between the known test sample andthe downloaded known test sample, a preferred mathematical tool or modelis the third (3rd) or fourth (4th) order bivariate polynomials.

For the modeling purpose, a mathematical tool is needed toquantitatively describe the color change behavior. Since color gamut canbe a 2D space and gamut mapping can be considered as a 2D spatialtransformation, a bivariate third-order (3rd-order) polynomial transferfunction is a preferable mathematical model. The bivariate 3rd-orderpolynomial transfer function is able to describe smooth 2D spatialtransformations with good precision, including translation, rotation,scaling, warping, etc. The 3rd-order polynomial transfer function alsohas appropriate balance between fitting precision and complexity. Inprinciple, second-order (2nd-order) and fourth-order (4th-order)polynomial functions can also be used to characterize the gamut mapping.

The color of the known test sample of graphics, including images orvideo on a target display interface, can be measured or modeled in ablock 402 as a group of data points on the chromaticity plane, a set ofthe coefficients for which usually cover an area of the plane. The areais the first (1st) display gamut.

A processor, an application specific integrated circuit (ASIC), anembedded processor, a microprocessor, a hardware control logic, ahardware finite state machine (FSM), a digital signal processor (DSP),or a combination thereof, such as the first control unit 312 of FIG. 3,the second control unit 334 of FIG. 3, or combination thereof, canmeasure or model the known test sample of graphics in the block 402.

An external communication device, a communication hub, an end point orterminal unit, transmitter, receiver, transceiver, or combinationthereof, such as the first communication unit 316 of FIG. 3, the secondcommunication unit 336 of FIG. 3, or combination thereof, can send,receive, or retrieve the known test sample of graphics in the block 402.A projector, a video screen, a speaker, or any combination thereof, suchas the first display 202, the second display 212, or combinationthereof, can provide a target display for known test sample of graphics.

The color of the known test sample of the graphics including images orvideo received from a remote device on the target display interface canbe measured or modeled in a block 404 as a group of data points on thechromaticity plane, which cover an area of the plane. The area is asecond (2nd) display gamut.

A processor, an application specific integrated circuit (ASIC), anembedded processor, a microprocessor, a hardware control logic, ahardware finite state machine (FSM), a digital signal processor (DSP),or a combination thereof, such as the first control unit 312 of FIG. 3,the second control unit 334 of FIG. 3, or combination thereof, canmeasure or model the received or retrieved graphics of the known testsample from a remote device in the block 404. A projector, a videoscreen, a speaker, or any combination thereof, such as the first display202, the second display 212, or combination thereof, can provide atarget display for the received or retrieved graphics of the known testsample.

An external communication device, a communication hub, an end point orterminal unit, transmitter, receiver, transceiver, or combinationthereof, such as the first communication unit 316 of FIG. 3, the secondcommunication unit 336 of FIG. 3, or combination thereof, can send,receive, or retrieve the received or retrieved known test sample ofgraphics in the block 404.

The 1st and the 2nd gamut of the known test sample are compared in ablock 406 to generate a model of gamut mapping (both forward andinverse) which can be stored in a model server such as a ColorDegradation Model Metadata server in the block 408.

A processor, an application specific integrated circuit (ASIC), anembedded processor, a microprocessor, a hardware control logic, ahardware finite state machine (FSM), a digital signal processor (DSP),or a combination thereof, such as the first control unit 312 of FIG. 3,the second control unit 334 of FIG. 3, or combination thereof, cancompare the known test sample and the retrieved known test sample in theblock 406.

A volatile memory, a nonvolatile memory, an internal memory, an externalmemory, or a combination thereof, such as the first storage unit 314,the second storage unit 346, or combination thereof, can store the modelof gamut mapping in a model server in the block 408.

The original image or video before uploading can be observed as verysimilar to the downloaded video clips if the obtained forward gamutmapping model is performed on the original image or video. Applying thegamut mapping can correctly describe the color change exhibited on thechromatic plane. Color correction can preferably be implemented in atarget or user device as software or hardware with embedded algorithms.A compensation model, which can include a degradation model such as thegamut mapping based Color Degradation Model Metadata, for a specificsource or web server can be applied to improve the quality of othergraphics including images or video received from the specific web serverin a block 410.

An external communication device, a communication hub, an end point orterminal unit, transmitter, receiver, transceiver, or combinationthereof, such as the first communication unit 316 of FIG. 3, the secondcommunication unit 336 of FIG. 3, or combination thereof, can send,receive, or retrieve the compensation model in the block 410.

Compensation or correction of unwanted color change can be implementedby reversing a color change process to change color quality back to theoriginal condition, such as performing an inverse 2D spatialtransformation (inverse gamut mapping) on the degraded images or video.Solving for the inverse function of the polynomial function is difficultsince the polynomial function is the 3rd-order bivariate function.

Alternatively, the inverse transformation can be generated by reversingthe order of the image or video. Using the original image or video asinput and degraded image or video as target, the calculation produces atransfer function for transforming original image or video into degradedimage or video. Given degraded image or video as input and originalimage or video as the output, the calculation yields a transfer functionthat transforms the degraded image or video into an image or video verysimilar to original image or video. Thus, inverse spatial transformationin target or user devices provides correction or improvement fordegraded images or video. The transfer function describing the inverse2D transformation is still a third-order bivariate polynomial function.

An exemplary degradation model such as a Color Degradation ModelMetadata is provided based on the comparison of color gamut for specificsource or web servers such as web video servers. Further, an exemplarycompensation model can include the exemplary degradation, an exemplarycorrection model, or combination thereof.

The gamut mapping algorithm for web video color correction can be alsodescribed using the mathematic language, i.e. the mathematical equationsor expressions.

Equations (1) and (2) define the gamut mapping relations between thetarget or original, and the remote or color degraded images, whereA=[a₁, a₂] represents the chromaticity of a pixel on the original imagewhile B=[b₁, b₂] is the chromaticity of a pixel on the degraded image.The transformation (or transfer function) T in Equation (1) describesthe color degradation induced by the issues over the internet. Accordingto previous discussion, T also represents the forward 2D transformationon the chromatic plane which converts A to B. On the contrary, T⁻¹represents the inverse transformation between A and B.B=T(A)  (1)A=T ⁻¹(B)  (2)

According to the spatial transformation based approach for gamutmapping, the degradation model is equivalent to the transformation thatdescribes color change from the known test sample to the downloadedknown test sample. The degradation model can also be represented by thetransformation T in Equation (1).

T can be numerically determined with the offline process introducedpreviously. In the preferred embodiment, T is a nonlinear function basedon the 3rd (or 4th) order bivariate polynomials. Accordingly, Equation(1) can be re-formulated as in Equation (3) using the matrix format.

$\begin{matrix}{\left\lbrack {b_{1}b_{2}} \right\rbrack = {\begin{bmatrix}1 & a_{1} & a_{2} & {a_{1}a_{2}} & a_{1}^{2} & a_{2}^{2} & {a_{1}^{2}a_{2}} & {a_{1}a_{2}^{2}} & a_{1}^{3} & a_{2}^{3}\end{bmatrix}\begin{bmatrix}t_{0}^{1} & t_{0}^{2} \\t_{1}^{1} & t_{1}^{2} \\t_{2}^{1} & t_{2}^{2} \\t_{3}^{1} & t_{3}^{2} \\t_{4}^{1} & t_{4}^{2} \\t_{5}^{1} & t_{5}^{2} \\t_{6}^{1} & t_{6}^{2} \\t_{7}^{1} & t_{7}^{2} \\t_{8}^{1} & t_{8}^{2} \\t_{9}^{1} & t_{9}^{2}\end{bmatrix}}} & (3)\end{matrix}$

Equation (2) can be re-formulated in the same way as in Equation (3).The twenty polynomial coefficients (t₀ ¹ . . . t₉ ¹, t₀ ² . . . t₉ ²)can be computed using the chromaticity data contained in the video clips(the original and the color degraded ones) and certain mathematicaltools such as, e.g., Matlab® available from The MathWorks, Inc. ofNatick, Mass.

If the preferred mathematical method, the 3^(rd) or 4^(th) orderbivariate polynomials, is used to define the degradation model, thepolynomial coefficients need to be computed or obtained based on thechromatic data obtained from both samples. In addition, certainmathematical tools or methods, e.g. Matlab® or user developed computerprograms, are also needed to compute the polynomial coefficients.

As for color correction, it is actually defined by Equation (2), theinverse gamut mapping process. When a web video clip is downloaded orstreamed to a computer/digital player, the chromatic values [b₁, b₂] ofeach pixel will be processed through Equation (2) (or more specificallythe inverse mapping version of Equation (3)) to obtain the originalcolor values [a₁, a₂] (or the corrected/improved color that is close to[a₁, a₂]) for the correct or improved color representation.

For color correction or compensation, a degradation model might not bedirectly needed. An inverse version of the degradation model might beused for color correction purposes. A compensation model can preferablyinclude the inverse version of the degradation model with or without thedegradation model.

To correct or compensate color degradation of a test sample, an inversetransformation can be applied to a downloaded known test sample, whichis also formulated in Equation (2). Equation (2) means that the knowntest sample (sample with corrected colors) can be obtained by applyingthe inverse transformation to the downloaded known test sample (colordegraded sample). Similar to the degradation model, the polynomialcoefficients can be computed for the inverse transformation if thepreferred mathematical method is used. The only difference is that theimage (B in Equation (1) and A in Equation (2)) and the original image(A in Equation (1) and B in Equation (2)) of the gamut mapping processare reversed between the two cases (Equations (1) and (2)): degradationmodel and its inverse version (correction model).

For illustrative purposes, the display system 100 provides colorcorrection or compensation. It is understood that the display system 100may also provide correction, compensation, or improvement of otherdisplay elements or display parameters such as aspect ratio, scale,smoothness resolution, frame rate, or combination thereof.

It has been discovered that the display system 100 provides acompensation model, including a degradation model, a correction model,or combination thereof, for specific remote devices based on a knowntest sample, which enables correction and improvement of any images orvideos from a specific remote device 106.

Further, it has been discovered that the gamut of the known test sampleof the graphics 204 on the display interface 202 of the first device 102can be compared to the gamut of the degraded test sample of the graphics214 on the display interface 202 of the first device 102 to provide thecorrection and improvement for images or video from the specific remotedevice 106.

Yet further, it has been discovered that other downloaded samples havethe same or similar degradation characteristics as the known testsamples. Therefore, the display system 100 can have the propercorrection mechanism for various downloaded samples of images or video.

The display system 100 has been described with module functions or orderas an example. The display system 100 can partition the modulesdifferently or order the modules differently. For example, the gamut ofthe graphics 204 of FIG. 2 on the first device 102 of FIG. 1 may bemeasured after the gamut of the graphics 214 of FIG. 2 on the seconddevice 106 of FIG. 1. The second display 212 of FIG. 2 may not beintegral to the second device 106.

The modules described in this application can be hardware implementationor hardware accelerators in the first control unit 312 of FIG. 3 or inthe second control unit 334 of FIG. 3. The modules can also be hardwareimplementation or hardware accelerators within the first device 102 orthe second device 106 but outside of the first control unit 312 or thesecond control unit 334, respectively.

The physical transformation from the compensation model, including adegradation model, a correction model, or combination thereof, resultsin the movement in the physical world, such as correction or improvementin displaying the graphics 204 or 214. Movement in the physical worldresults in changes to the images or video by color or chromaticitychanges as perceived by user eyes.

Referring now to FIG. 5, therein is shown a flow chart of a method 500of operation of a display system 100 in a further embodiment of thepresent invention. The method 500 includes: sending a known test samplein a block 502; retrieving the known test sample in a block 504;comparing the known test sample and the retrieved known test sample in ablock 506; generating a compensation model based on the comparison forcorrecting the retrieved known test sample in a block 508; and providingthe compensation model for displaying a corrected display on a device ina block 510.

The resulting method, process, apparatus, device, product, and/or systemis straightforward, cost-effective, uncomplicated, highly versatile,accurate, sensitive, and effective, and can be implemented by adaptingknown components for ready, efficient, and economical manufacturing,application, and utilization. Another important aspect of the presentinvention is that it valuably supports and services the historical trendof reducing costs, simplifying systems, and increasing performance ofinformation technology and consumer electronic products.

These and other valuable aspects of the present invention consequentlyfurther the state of the technology to at least the next level.

While the invention has been described in conjunction with a specificbest mode, it is to be understood that many alternatives, modifications,and variations will be apparent to those skilled in the art in light ofthe foregoing description. Accordingly, it is intended to embrace allsuch alternatives, modifications, and variations that fall within thescope of the included claims. All matters set forth herein or shown inthe accompanying drawings are to be interpreted in an illustrative andnon-limiting sense.

What is claimed is:
 1. A method of operation of a display systemcomprising: sending a known test sample for storing the known testsalmple on a web server; retrieving the known test sample; comparing,with a control unit, a gamut map of the known test sample and a gamutmap of the retrieved known test sample; generating a compensation modelbased on the comparison for correcting the retrieved known test sample;and providing the compensation model for displaying a corrected displayon a device.
 2. The method as claimed in claim 1 wherein generating thecompensation model includes generating a model based on spatialtransformation.
 3. The method as claimed in claim 1 wherein generatingthe compensation model includes generating a model based on inversespatial transformation.
 4. The method as claimed in claim 1 whereinproviding the compensation model includes providing Color DegradationModel Metadata.
 5. A method of operation of a display system comprising:sending a known test sample having a gamut map for storing the hnozvntest sample on a web server; retrieving the known test sample having adegraded gamut map; comparing, with a control unit, the gamut map of theknown test sample and the degraded gamut map of the retrieved known testsample; generating a compensation model based on the comparison forcorrecting the retrieved known test sample; and providing thecompensation model for displaying a corrected display on a device. 6.The method as claimed in claim 5 wherein sending the known test sampleincludes sending the known test sample having colors that uniformlycover an available gamut range.
 7. The method as claimed in claim 5wherein generating the compensation model includes generating a modelbased on a two-dimensional spatial transformation.
 8. The method asclaimed in claim 5 wherein generating the compensation model includesgenerating a model based on inverse spatial transformation with areverse order of the known test sample and retrieved known test sample.9. The method as claimed in claim 5 wherein providing the compensationmodel includes providing Color Degradation Model Metadata for storage ona model server.
 10. A display system comprising: a communication unitconfigured to send a known test sample for storing the know test sampleon a web server and configured to retrieve the known test sample; acontrol unit, coupled to the communication unit, configured to compare agamut map of the known test sample and a gamut map of the retrievedknown test sample, and configured to generate a compensation model basedon the comparison for correcting the retrieved known test sample; and astorage unit, coupled to the control unit, configured to provide thecompensation model for displaying a corrected display on a device. 11.The system as claimed in claim 10 wherein the control unit configured togenerate the compensation model includes the control unit configured togenerate a model based on spatial transformation.
 12. The system asclaimed in claim 10 wherein the control unit configured to generate thecompensation model includes the control unit configured to generate amodel based on inverse spatial transformation.
 13. The system as claimedin claim 10 wherein the storage unit configured to provide thecompensation model includes the storage unit configured to provide ColorDegradation Model Metadata.
 14. The system as claimed in claim 10wherein: the communication unit is configured to retrieve the known testsample having a degraded gamut; and the control unit is configured tocompare the gamut of the known test sample and the degraded gamut of theretrieved known test sample.
 15. The system as claimed in claim 14wherein the communication unit configured to send the known test sampleincludes the communication unit configured to send the known test samplehaving colors that uniformly cover an available gamut range.
 16. Thesystem as claimed in claim 14 wherein the control unit configured togenerate the compensation model includes the control unit configured togenerate a two-dimensional spatial transformation.
 17. The system asclaimed in claim 14 wherein the control unit configured to generate thecompensation model includes the control unit configured to generate amodel based on inverse spatial transformation with a reverse order ofthe known test sample and retrieved known test sample.
 18. The system asclaimed in claim 14 wherein the storage unit configured to provide thecompensation model includes the storage unit configured to provide ColorDegradation Model Metadata for storage on a model server.